ED 055 248 

AUTHOR 

TITLE 



DOCUMENT RESUME 



INSTITUTION 



SPONS AGENCY 

BUREAU NO 
PUB DATE 
GRANT 
NOTE 



EDR3 PRICE 
DESCRIPTORS 



IDENTIFIERS 



52 VT 014 111 

Valentine, Ivan E.; Lowery, Nelson W. 

Metropolitan Area Application of Vocational Education 
Innovations Resulting from Research and Development 
Programs. Final Report, Institute IX, Volume I. Final 
Report 

Albuquerque Technical Vocational Inst., N. Mex. ; 
Colorado State Univ., Ft. Collins. Dept, of 
Vocational Education. 

National Center for Educational Research and 
Development (DHEW/CE) , Washington, D.C. 

BR- 9-0524 
Jun 71 

OEG-0- 9-1 50524-4520(725) 

1 59 p. ; Part of Short Term Institutes for Inservice 
Training of Professional Personnel Responsible for 
Vocational-Technical Education in Western 
Metropolitan Areas 

M F- $ 0 . 65 H C- $ 6 . 58 

Change Agents; Community Resources; Curriculum 
Development; ^Educational Change; Educational 
Innovation; Guidelines; Information Systems; 
^Institutes (Training Programs) ; *Me tropolitan Areas; 
Models; Program Development; Program Planning; 
Research Tools; ^Research Utilization; Simulation; 
Urban Areas; ^Vocational Education 
Delphi Technique 



ABSTRACT 

Fifty vocational educators, including directors of 
Research Coordinating Units, participated in a 1-we institute 
designed to identify ways to revitalize vocation? ^ .tion in 
metropolitan areas. The participants heard and re to 

presentations by five nationally recognized individuals which 
emphasized change process and educational innovation. Participants 
also met in small groups to develop models and guidelines useful in 
implementing change in their home states. On the last day a posttest 
was administered which indicated participants were generally well 
pleased with the presentations and overall operation. Also, evidence 
indicated that a majority of participants had implemented planned 
program changes as a result of having attended the institute. The 
five major presentations are available in VT 014 112 in this issue. 
(Author/JS) 
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SUMMARY 



GRANT NO.: OEG-0-9-150524-452G (725) 

TITLE: Metropolitan Area Application of Vocational Education 

Innovations Resulting from Research and Development 
Programs 

PROJECT DIRECTOR: Dr. Ivan E. Valentine 

Department of Vocational Education 
Colorado State University 
Fort Collins, Colorado 

INSTITUTION: Albuquerque Technical-Vocational Institute 

in cooperation with Colorado State University 
Department of Vocational Education 

INSTITUTE DATES: September 14, 1970 to September 18, 197v 



Problem , Purposes and Ob i ectives 

An abiding concern in vocational education is how to improve the 
image of vocational education in metropolitan area schools. Recent 
literature in education has pointed out the fact that a large gap presen 
ly exists between research and practical application cf the resu ts. 

Changes in vocational programs traditionally have not resulted from 
research and development activities designed to improve local vocatrona 
education programs. Modern means of collection, storage, dissemination 
of the findings of research and development activities hold great promise 
for application of research results. Not all research and deve 
activities result in positive action in the change process, 
edge explosion and the modern technology (computers) give the educator 
a resource that has not been fully utilized in planning, developing, and 
evaluating local programs of vocational education. The greatest deterrent 
factor in implementing planned change is the diffusion of relevant in- 
formation to those key individuals who are in a position to make change. 

One of the greatest challenges in this institute is to provoke on part 
of the participants and consultants a common understanding of mutual 
problems, and to develop several techniques whereby the results of research 
and development can be refined and simplified for application y c ass 
room teachers- 

The central purpose of this institute is to evaluate the results of 
research and development activities which are designed to acce erate t e 
adoption and application of innovations in vocational education for 
metropolitan areas. Concurrently, the results will provide those 
individuals with present state and local administrative responsibilities 
with the fundamental, theoretical and philosophical concepts coupled with 
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basic principles for effective program development and operation essential 
to expanding vocational education in metropolitan areas. The institute is 
organized to provide a research base relative to identifying innovations 
and the change process as it relates to revitalizing vocational education 
in metropolitan areas. 



To accomplish these purposes specific objectives were established as 
follows : 

1. To examine and categorize the information services educators need 
in order to use research and other technical information in plan- 
ning, implementing, and evaluating vocational education programs. 



2. To assess the major active or planned information systems or 
services relevant to vocational education. 

3. To identify gaps in present systems for acquiring, processing, 
announcing, disseminating, analyzing, and interpreting education 
report literature; particularly for documents generated by state 
and local educational agencies. 

4. To develop alternative models for organizing needed services with 
potential for high cost benefited returns, specifying information 
service roles, functions, and activities at local, intermediate, 
state and multi- state levels* 

5. To test models using simulations and other appropriate data. 



Procedures and Activities 



The institutes content and agenda are categorized 
phases, pre-institute activities, institute activities 
activities. 



into three major 
and post-institute 



The pre-institute activities consisted of a planning committee which 
met for two days in January of 1970 for the purpose of planning the in- 
stitute relative to refining: 



1. Objectives of the Institute 

2. Participant Selection 

3. Consultant and institute staff responsibilities 



Individuals with national recognized expertise on selected 
pared papers on five topics which were sent to reactors and 
in advance of the institute. The reactors prepared written 
the papers. 



subjects pre- 
participants 
reviews of 



To accomplish the purposes and activities established, 
activities were used during the one-week institute. One of 
major topics was introduced each day. Two reactors who had 



a variety of 
the five 
reviewed and 
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criticized the paper in advance made an oral presentation on the topic 
to set the stage for small group working sessions. Participants were 
assigned to small working groups to carry on predetermined expected 
achievements (developing models, guidelines and so forth). 



A post-test was administered on the last day of the institute which 
was designed to elicit data relative to the institute and its effectiveness. 
Six months after the institute, a follow-up instrument was administered to 
participants to assess the vocational education program changes made or 
planned that resulted from participants having attended the institute. 

Participants selected were from State Research Coordinating Units, 
directors of research in city school systems, state directors and assis- 
tant state directors of vocational education and curriculum coordinators 
or developers* Eighteen states were represented by the 50 participants 
who had varied responsibilities and experiences which added to the value 
and enrichment of the institute. 



Cone lus ions and Recommenda t ions 

As a result of the work done by the participants the following 
conclusions were developed! 

1. The geographical mix of the participants promoted valuable 
exchange of information about innovations resulting from 
research and development programs. 

2. Selection of participants provided cross-sectional variety of 
service areas, institutional classifications, and professional 
position classifications. 

3. Evaluation results indicated that participants were generally 
well pleased with the presentations and overall operation of the 
institute . 

4. The evidence indicated that a majority of participants had re- 
evaluated their programs and had implemented or planned to 
implement positive program change as a result of having attended 
the institute. 

5* All of the participants felt they had explored and learned new 

ideas and concepts that related to actual practice in programming 
vocational offerings in metropolitan areas. 

The following recommendations are offered based on the experience of 
the institute and on the evaluation instruments: 

1. Institutions should be encouraged to sponsor institutes providing 
for continuation of training in the application of vocational education 
innovations resulting from research and development programs. 
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2. At future institutes, every effort should be made to attract 
participants from new and developing institutions and programs. 

3. Preparation and dissemination of printed material related to 
practical situations that can be used immediately by the par- 
ticipants should be continued and improved. 

4. A study should be conducted to decermine the need for training 
vocational educators in research and development techniques. 

5. Time for individual and group participation in the program 
should be continued. 



Results : 

According to the evaluation devices employed during and fol owing 
the institute the objectives which were established were apparen -y 
achieved, thus indicating a successful institute. The majority ; : the 
participants responded to the institute by utilizing the information 
and ideas presented; therefore, demonstrating the timeliness and rel- 
evance of the institute to the individual attending,, 
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INTRODUCTION 



The Problem 

Both the Vocational Education Act of 1963 and the Vocational Education 
Amendments of 1968 provide for, and in fact require, evaluation of vocational 
education programs. The Declaration of Purpose states in part t at s 

are authorized to . . . "improve existing programs of vocational education 

. . . and that persons of all ages . . . "will have ready access to voca- 

tional training or retraining which is of high quality .... 



Before ex 
grains 01 hie 
of evaluation 
and often his 
of vocaticnai 
recognising - 
have not yet 
an effective 



i sting programs can be rT imp roved ir and before access to pro 
r quality” can be insured, adequate systems and techniques 
must be developed an 1 put into operation. The use of quick 
nly subjective device.3 for appraising the quantity and quality 
programs will not suffice. Professional educators are 
he importance and complexity of the evaluation process but 
taken the necessary seeps to fully develop and operationalize 
evaluation program. 



The infant status of evaluation may in part account 
common shortcomings of past evaluation efforts. 



for the many 



1. Most evaluative efforts have failed to provide valid and reliable 
information needed to support sound decision-making because o 
the following: 

a. Reports often contain only impressionistic information 

b. Many reports are almost devoid of hard data 
c* An over-reliance on anecdotal comments 

d. An over -reliance on subjective determinations 



2 . 



Evaluations have focused almost entirely on the educational 
process-curricular organization, staff activities and qualifi- 
cations, and physical facilities while ignoring program outcomes. 
Process evaluations by themselves cannot gauge program effective- 



ness • 



3. Evaluations have too often been an afterthought, partial and 
sporadic rather than planned, thorough and continuous. 

Unfortunately, the status of evaluation in both vocational and 
general education today can be summarized as follows: 

1. There is a lack of adequate theory pertaining to the nature of 
evaluations which are needed to effectively accommodate educa- 
tional programs. 

2. There is a lack of knowledge about decision-making processes and 
information requirements. 
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3. There is a lack of appropriate evaluation instruments and pro- 
cedures for gathering data. 

4. There is a lack of mechanisms for organizing, processing, and 
reporting evaluative information* 

5. There is a critical shortage of trained evaluators. 

It was an awaren-.. f the problems facing those who must evaluate and 
recognition of che imp or tv...-- contribution that well-designed evaluations 
can make to improving occa tc:nal education programs that supported the 
need for conducting thi.^ in^rritut '* 

Purposes of the Institute 

The central purpose of this institute was to evaluate tha results of 
research and development ae. iviti_=s which are designed to accelerate the 
adoption and application o: innovations in vocational education for metro- 

politan areas. Concurrently the results have provided those individuals 
with present state and loco 1 administrative responsibilities with the 
fundamental theoretical ar.„ ohilc sophical concepts coupled with basic 
principles for effective program development and operation essential to 
expanding vocational education in metropolitan areas. The institute was 
organized to provide a research base relative to identifying innovations 
and the change process as it related to revitalizing vocational education 
in metropolitan areas# 

An abiding concern in vocational education is how to improve the image 
of vocational education in metropolitan area schools. Recent literature 
in education has pointed out the fact that a large gap presently exists 
between research and practical application of the results. 

Changes in vocational programs traditionally have not resulted from 
research and development activities designed to improve local vocational _ 
education programs. Modern means of collection, storage, and dissemination 
of the findings of research and development activities hold great promise 
for application of research results. Not all research and development 
activities result in positive action in the change process. The knowl- 
edge explosion and the modern technology (computer) give the educator 
a resource that has not been fully utilized in planning, developing, and 
evaluating local programs of vocational education. 'Hie greatest deterrent 
factor in implementing planned change, is the diffusion of relevant in- 
formation to those key individuals who are in a position to make change. 

One of the greatest challenges in this institute was to provoke on part 
of the participants and consultants a common understanding of mutual 
problems, and to develop several techniques whereby the results of research 
and development can be refined and simplified for application by class- 
room teachers. 

A. review of present ^..nf orirat ion systems, ERIC an>s others, to assess 
their impact for contributing to the change process I eaves much to be 
desired. A major responsibility for vocational education in metropolitan 
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areas is to determine what is valid and reliable information. Educa 
must devise a means to manipulate and segregate this mass of data in 
meaningful models or processes to stimulate changes based on democra 
decisions designed specifically to improve the instruction program. 



tor s 
to 
t ic 



A major gap in disseminating inform- Ion is directly related to the 
development of effective techniques and procedures for identifying what 
structural linkages exist between the decision-maker, and those responsible 
for implementing decisions, and to expl re in depth the specific communi- 
cation blocks that restrict the flow o ^formation within an organization. 



The data available from present systems or models PPBS--PERT may be 
viewed as being systems research; however, much needs to be accomplished 
in vocational education to close the gap between expectations and achieve- 
ment in the application of these systems. A study of several models 
(Manpower - evaluation, program planning) was presented and reviewed with 
the intent of redesigning in terms of applications, or stipulating how 
they can be manipulated for application relative to improving the utiliza- 
tion of the systems approach in a mope fertile and valid way. 

A portion of this institute was directed to fostering the fertility 
of imagination to create models or other devices to enable school admin- 
istrators to redirect community resources to strengthen the vocational 
education program. Further probing into exemplary and demonstration 
projects was integrated and studied for the feasibility of application 
to meet the metropolitan area needs. Models generated from the institute 
and those from other resources were tested for applicability in fostering 
a speed up between the completed research and the implementation of findings. 
Very little is known about the process of how the results of research or 
new ideas move through the structure in the educational system. 



It was to this end that the institute was dir ected- the implementation 
of positive change for vocational education in the metropolitan areas. 
Ultimately, the institute provided vocational educators and other researc 
ers with specific information relative to the applications of techniques 
for reducing the lag time between research and program implementation. 



Objectives of the Institute 

The specific objectives established for the institute were as follows: 

1. To examine and categorize the information services educators need 

in order to use research and other technical information in planning, 
implementing and evaluating vocational education programs. 

2. To assess the major active or planned information systems or 
services relevant to vocational education. 

3. To identify gaps in present systems for acquiring, processing, 
announcing, disseminating, analyzing and interpreting education 
report literature. Particularly for documents generated by state 
and local educational agencies. 
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4 . 



To develop alternate models for organizing needed services with 
potential for high cost benefited returns, spe, ifying information 
service roles, functions, and activities at local, intenro.diate, 
state, and multi-state levels* 

5* To test models using simulations and other appropriate data* 

Contributions to Vocational Education 



Ultimately the institute provided information and techniques relevant 
to devising strategies to facilitate the acceptance a ad expansion of 
vocational education in metropolitan areas. The institute made a further 
contribution to education by providing the models to a local school system 
desiring to become more effective in permeating information about voca- 
tional education throughout their organization. 

Instit u te Repor t 

The final report on the institute has been prepared in two parts; 

(1) Volume I, which includes all information relative to the institute 
except the text of the papers of the five major topics presented and 

(2) Volume II, an instructional materials supplement that includes the 
complete text of the five top ics presented . 
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METHODS AND PROG EDI .S 



The institute content an agenda are in- 
into three major phases, pre-institute acfcivi 
and post-institute activities. 

Pre-Institute Activities 

1. Planning Committee (2-days) 

A meeting was held in January oA l c 7< 
the institute relative to refining: 

a . objectives of th<^ institute 

b. participant selection 
c . consultant and institute staff 

The meeting was planned to be held i 
The arrangements for facilities requ 
institute were coordinated with the 
meeting • 

2. Instructional material preparation 

Individuals with nationally recognized expertise on the selected 
subjects prepared papers which set the stage for participant 
working sessions. The objectives of this technique were to 
develop skills and competencies on the part of the participants 
to develop an understanding whereby they could contribute to 
the overall development of models, systems, and other special 
instrumentation for testing models and provide the participants 
with skills in developing and testing simulation material as a 
result of attending the institute. 

Institute Operation 

1. The five papers were prepared in advance and sent to reactors 
who presented written reviews of the papers during the institute. 
Two or three qualified reactors reviewed and critiqued the pre- 
pared papers in advance, then made oral presentations and set 
the stage for small group working sessions. 

2. The participants selected to attend the institute received copies 

of the consultant's prepared papers in advance v ■ ^ s > and were 

instructed in the techniques to be utilised in tu, iteration of 
the institute prior to attending the institute, 

3. The institute began on a Sunday, which was utilized in registering 
participants and completing the necessary administrative details. 
Part of the Monday morning session was also used for this purpose. 

4. A meeting of consultants, reactor*.-, discussion leaders, recorders 



for the purpose of planning 



r~sponsib il it ie s . 

. ilbuquerque. New Mexico. 
..red for conducting the 
. r onsoring agency at this 



jded below and are categorized 
ies, institute activities, 
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and institute staff members was held to discuss the week’s 
activities during the administration and registration of 
participants . 

5. Participants were assigned to small working groups prior to 
attending the institute. The institute staff selected a 
discussion leader for each group in advance* 

6. The first reactor panel was presented at a Monday luncheon (45-60 
minutes) , then participants were broken into their smaller working 
groups for carrying on predetermined expected achievements (de- 
veloping models - guidelines and so forth) • These small groups 
met together Monday afternoon and Tuesday a.m. Each discussion 
leader appointed a recorder who was responsible for recording 

and reporting that group 1 s activities and the material developed 
therein . 

7. A new topic was introduced at the noon luncheon each day and the 
same method of operation prevailed throughout the week for the 
period of the institute. Facilities were made available to 
participants at all times in the event that they wished to work 
on specific topics during the evening hours. 

Staff, Consultants and Participants 

A total of 50 participants were selected from state RCU directors, 
directors of research in city school systems, state directors and assistant 
state directors of vocational education and curriculum coordinators. Plans 
called for the selection of 25 superintendents, or assistant superinten- 
dents, or state department personnel, 15 RCU directors, and 10 classified 
in curriculum or coordination* A complete list of institute staff, con- 
sultants and participants is included in Appendix A. 

Agenda 

A complete agenda for the six days of the institute, September 13 
through September 18, 1970 is included in Appendix B. 

Facilities 

Facilities required for this institute were one large meeting room for 
60 people and 3 small meeting rooms for approximately 15 to 20 persons 
each. Typewriters and secretarial space were required. Facilities were 
also required for lodging and board for participants and institute staff. 

A facility was required to handle a noon luncheon Monday through Friday 
and also must provide facilities (audio-visual, etc.) for the reactor T s 
contribution to the scheduled program. 

Evaluation 

A major topic was discussed on each of the five days of the institute. 
Participants were asked to evaluate each topic at completion of the group 
discussions for each major topic by means of a one-page (five item) 
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evaluation sheet. These sheets were color coded for each day as the 
same criteria was used for each topic. Copies of the evaluation sheets 
are included in Appendix C. 

A questionnaire was developed to determine the institute participants 
attitude or feelings concerning Vocational Education, This instrument 
was administered to all participants on the first day of the institute, 

A copy of the instrument is included in Appendix D. 

An inventory (participant self-appraisal) in the form of a post-test 
was administered on the last day of the institute. The inventory was de- 
signed to elicit from participants data relative to the institute and its 
effectiveness for accomplishing stated objectives. Concurrently, it 
measured participant attitude about new concepts gained as a direct result 
of attending the institute. A copy of the post-test is included in Appendix E. 

A post-institute follow-up instrument was developed and administered 
to all participants six months after the institute to assess the voca- 
tional education program changes made or planned that resulted from 
participants having attended the institute. A copy 01 the instrument 
is included in Appendix F. 



Institute Personnel 



Project Director Ivan E. Valentine Dr. Valentine received his 

B.S. at South Dakota State University, the M.E. from Colorado State 
University and a Ph.D. at The Ohio State University, Columbus, Ohio. 

He has had eight years as a local director of vocational education, 
served as president of a Technical Institute, three years as a state 
coordinator of area schools in North Carolina, three years as assistant 
director for State Department of Community Colleges, North Carolina. 

Dr. Valentine served three years as consultant and research associate 
at The National Center for Vocational and Technical Education, The Ohio 
State University. Present duties at Colorado State University include 
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